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MAGIC is a system of two Imaging Atmospheric Cherenkov Telescopes located on the Canary 
island of La Palma, Spain. During summer 2011 and 2012 it underwent a major upgrade. The 
main subsystems upgraded were the MAGIC-I camera and its trigger system and the readout 
system of both telescopes. We use observations of the Crab Nebula taken at low and medium 
zenith angles to assess the key performance parameters of the MAGIC stereo system. For low 
zenith angle observations, the standard trigger threshold of the MAGIC telescopes is about 50 
GeV. The integral sensitivity for point-like sources with Crab Nebula-like spectra above 220 GeV 
is (0.66 ±0.03)% of Crab Nebula flux in 50 h of observations. The angular resolution, defined as 
the sigma of a 2-dimensional Gaussian distribution, at energies of a few hundred GeV is below 
0.07°, while the energy resolution is around 16%. We investigate the effect of the systematic 
uncertainty on the data taken with the MAGIC telescopes after the upgrade. We estimate that 
the systematic uncertainties can be divided in the following components; < 15% in energy scale, 
11 — 18% in flux normalization and ±0.15 for the slope of the energy spectrum. 
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1. Introduction 

MAGIC (Major Atmospheric Gamma Imaging Cherenkov telescopes) is a system of two 17 m 
diameter Imaging Atmospheric Cherenkov Telescopes (lACTs). The telescopes are located at a 
height of 2200 m a.s.l. on the Roque de los Muchachos Observatory on the Canary Island of La 
Palma, Spain (28°N, 18°W). They are used for observations of particle showers produced in the 
atmosphere by very high energy (VHE, > 30GeV) y-rays. Between summer 2011 and 2012 the 
telescopes went through a major upgrade (Aleksic et ah, 2015a), carried out in two stages. In the 
first part of the upgrade, in summer 2011, the readout systems of both telescopes were upgraded 
(Sitarek et ah, 2013). The multiplexed FADCs used before in MAGIC-I (Goebel et ah, 2007) as 
well as the Domino Ring Sampler version 2 used in MAGIC-II (DRS2; Tescaro et ah, 2009) have 
been replaced by Domino Ring Sampler version 4 chips (DRS4; Ritt et ah, 2010). The switch to 
DRS4 based readout allowed to eliminate the ~ 10% dead time present in the previous system due 
to the DRS2 chip and lowered the electronic noise of the readout. In summer 2012 the second 
stage of the upgrade followed with an exchange of the camera of the MAGIC-I telescope to a 
uniformly pixelized one (Aleksic et ah, 2015a). Currently each MAGIC camera is equipped with 
1039 photomultipliers (PMTs) and has a total field of view of ~ 3.5°. The upgrade of the camera 
allowed to increase the area of the trigger region in MAGIC-I by a factor of 1.7 to the value of 4.8 
square degrees. 

2. Data sample and analysis 

We evaluate the performance of the MAGIC telescopes using data from the Crab Nebula, the 
so-called standard candle of VHE y-ray astronomy. The data have been taken between October 
2013 and January 2014 in the so-called wobble mode (Fomin et ah, 1994), i.e. with the source po¬ 
sition offset by 0.4° from the center of the camera. This method allows to simultaneously estimate 
the background from reflected positions in the sky at the same offset. The data are divided into two 
sub-ranges according to the zenith angle of the observations: 5 — 30° (11 h) and 30 — 45° (4 h). The 
data have been analyzed using the standard MAGIC tools: MARS (MAGIC Analysis and Recon¬ 
struction Software, Zanin et ah, 2013). The analysis chain (extraction of Cherenkov light pulses, 
calibration to photoelectrons (phe), image cleaning and parametrization, y/hadron separation, esti¬ 
mation of energy and arrival direction) is described in detail in Aleksic et al. (2015b). 

3. Performance parameters 

Here we present the most important performance parameters of the MAGIC telescopes: energy 
threshold, angular resolution, energy resolution and sensitivity. 

3.1 Energy threshold 

The energy resolution of an lACT is normally defined as the peak of the differential energy 
distribution obtained with Monte Carlo (MC) events weighted to a particular spectral shape. In 
here we assume for the calculation the commonly used spectral index of —2.6. 
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Figure 1: Left panel: rate of MC 7 —ray events (in arbitrary units) surviving the image cleaning with at least 
50 phe for a source with a spectral index of —2.6 in the zenith range < 30° (solid line) and 30 — 45° (dotted 
line). Right panel: threshold of the MAGIC telescopes as a function of the zenith angle of the observations 
at the trigger level (the dotted curve), only events with images that survived image cleaning in each telescope 
with at least 50phe (solid line) and with additional cuts of Hadronness < 0.5 and 0^ < 0.03°^ (dashed line). 
Both panels reproduced from Aleksic et al. (2015b). 


In the left panel of Fig. we show the differential rate plot in two zenith angle ranges for 
events that survived image reconstruction in both telescopes. For low zenith angle, i.e. < 30°, the 
reconstruction threshold energy is ~ 70GeV. Note however that the peak is broad and extends far 
to lower energies, allowing to evaluate the performance of the telescopes and to obtain scientific 
results below such defined fhreshold. In fhe righf panel of Fig. [I] we show how fhe energy fhreshold 
of fhe MAGIC felescopes depends on fhe zenifh angle of observafions. The fhr'eshold is quife sfable 
for low zenifh angle observafions. If increases rapidly for higher values of zenifh angles, due fo 
bofh fhe larger absorpfion of fhe Cherenkov lighf in fhe afmosphere and fhe dilution of fhe phofons 
reaching fhe ground over a larger lighf pool. 

3.2 Energy resolution 

We evaluate fhe performance of fhe energy reconsfrucfion wifh 7 —ray MC simulations. The 
simulations are divided info bins of frue energy (5 bins per decade). In each bin we consfrucf 
a disfribufion of {Egst — Etrue)IEtrue and fif if wifh a Gaussian function. The Gaussian function 
describes well fhe disfribufion in fhe cenfral region, buf nof af fhe edges (see Aleksic ef ah, 2015b). 
The energy resolufion and bias are defined as fhe sfandard deviafion and fhe mean value respecfively 
of fhis fif. Bofh quanfifies are ploffed as a function of fhe frue energy of fhe 7 rays in Fig. ^ 

For low zenifh angle observafions in fhe energy range of a few hundred GeV fhe energy reso¬ 
lufion is as low as ~ 15%. For higher energies if degrades due fo an increasing fracfion of fruncafed 
images, and showers wifh high impacf parameters as well as worse sfafislics in fhe fraining sample. 
Al low energies fhe energy resolufion is degraded, due fo worse precision in fhe image reconslruc- 
lion (in parlicular fhe impacf parameters), and higher internal relalive fluclualions of fhe shower. 
Above a few hundred GeV fhe absolule value of fhe bias is below a few percenl. Al low energies 
(< 100 GeV) fhe eslimaled energy bias rapidly increases due fo fhe Ihr'eshold effecl. For observa¬ 
fions al higher zenifh angles fhe energy resolufion is similar. Since an even! of fhe same energy 
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Figure 2: Energy resolution (solid lines) and bias (dashed lines) obtained from the MC simulations of 7 rays 
at low (red) and medium (blue) zenith angles. Events have been weighted in order to represent a spectrum 
with a slope of —2.6. Eor comparison, pre-upgrade values from Aleksic et al. (2012) are shown in gray lines. 
The figure is reproduced from Aleksic et al. (2015b). 

observed at higher zenith angle will produce a smaller image, the energy resolution at the lowest 
energies is slightly worse. On the other hand, at multi-TeV energies, the showers observed at low 
zenith angle can be partially truncated at the edge of the camera or saturate some of the pixels. 
Therefore the energy resolution at those energies is slightly better for higher zenith angle observa¬ 
tions. On the other hand, as the energy threshold shifts with increasing zenith angle, the energy 
bias at energies below 100 GeV is much stronger for higher zenith angle observations. 

3.3 Angular resolution 

Following the approach in Aleksic et al. (2012), we investigate the angular resolution of the 
MAGIC telescopes using two commonly used methods. In the first approach we dehne the angular 
resolution ©oaus as the standard deviation of a 2-dimensional Gaussian htted to the distribution of 
the reconstructed event directions of the 7 -ray excess. Such a 2-dimensional Gaussian in the dx and 
By space will correspond to an exponential htting function for 6^ distribution. The fit is performed 
in a narrow range, 6^ < 0.025°^. Therefore it is an appropriate quantity for estimating performance 
of the instrument in case of a search for small extensions (comparable with angular resolution) in 
VHE 7 —ray sources. In the second method we compute an angular distance, 0o.68> around the 
source, which contains 68 % of the excess events. This method is more sensitive to long tails in the 
distribution of reconstructed directions. Note that while both numbers assess the angular resolution 
of the MAGIC telescopes, their absolute values are different. For a purely Gaussian distribution 
©Gaus would correspond to only 39% containment radius of 7 -rays originating from a point-like 
source and © 0.68 ~ l-5©Gaus- 

We use the low and medium zenith angle samples of the Crab Nebula to investigate the angular 
resolution. The angular resolution obtained with both methods is shown in Fig. ^ At 250GeV the 
angular resolution (computed with the 2D-Gaussian fit) is 0.07°. It improves with energy, as larger 
images are better reconstructed, reaching a plateau of ~ 0.04° above a few TeV. The angular reso¬ 
lution improved by about 5-10% after the upgrade. Due to the improvement in angular resolution 
the small difference between the angular resolution obtained with MC simulations and the Crab 
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Figure 3: Angular resolution of the MAGIC telescopes after the upgrade as a function of the estimated 
energy obtained with the Crab Nebula data sample (points) and MC simulations (solid lines). Left panel: 
2D Gaussian fit, right panel: 68% containment radius. Red points: low zenith angle sample, blue points: 
medium zenith angle sample. For comparison the low zenith angle pre-upgrade angular resolution is shown 
as gray points Aleksic et al. (2012). Reproduced from Aleksic et al. (2015b). 

Nebula data, also present in the pre-upgrade data, is slightly more pronounced. The difference of 
~ 10— 15% is visible at higher energies and corresponds to an additional 0.02° systematic random 
component (i.e. added in quadrature) between MC and data. Study of the reconstructed source di¬ 
rection spread in each of 10 nightly sub-samples of the Crab Nebula data suggest a similar, < 0.02°, 
systematic uncertainty on the pointing position (Aleksic et al., 2015b). 

3.4 Sensitivity 

For a weak source, the significance of an excess of Agxcess events over a perfectly-well known 
background of Abkg events can be calculated as Aexcess/ y/Abkg- Therefore, one defines fhe sensi- 
fivify as fhe flux of a source giving Aexcess/y^Nbkg = 5 affer 50h of effective observa¬ 

tion time. For a more realistic esfimafion of fhe sensifivify, we apply fwo addifional conditions: 
Aexcess > 10 and Nexcess > 0.05Abkg- The firsf condition assures fhaf fhe Poissonian sfafisfics of fhe 
number of evenfs can be approximafed by a Gaussian disfribufion. The second one counferacfs 
fhe effecf of small sysfemafic discrepancies befween fhe ON and OFF disfribufions, which could 
mimic a sfafisfically significanf signal if fhe residual background rate is large. 

The integral sensitivity of the different phases of the MAGIC experiment for a source with a 
Crab Nebula-like spectrum are shown in the left panel of Fig. In order to find fhe opfimal cuf 
values in Hadronness (//hadron separation parameter) and 6^ in an unbiased way, we splif fhe 
fofal sample of Crab Nebula dafa info fwo independenf sub-samples {training and test) of similar 
size and similar observation conditions. Differenl energy fhr'esholds are achieved by varying a cuf 
in fhe fofal number of phofoelecfrons of fhe images (for points < 300 GeV) or in the estimated 
energy of the events (above 300 GeV). For each energy threshold we perform a scan of cuts on the 
training sub-sample. The pair of cuts which provides the best sensitivity on the training sub-sample 
is selected and applied to test sample to obtain the final sensifivify value. The fhreshold ilself is 
esfimafed as fhe peak of frue energy disfribufion of MC evenfs wifh a —2.6 specfral slope fo which 
fhe same cufs were applied. 
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Figure 4: Integral (left panel) and differential (right panel, 5 bins per decade in energy) sensitivity of the 
MAGIC telescopes expressed in Crab Units. The sensitivity is defined as the flux of the source in a given 
energy range for which Nexcess/= 5 and Aexcess > 10, A^excess > O.OSAbkg after 50h of effective time. 
Left panel: Gray circles: sensitivity of the MAGIC-I single telescope with the Siegen (light gray, long 
dashed, Albert et al. (2008)) and MUX readouts (dark gray, short dashed, Aleksic et al. (2012)). Black 
triangles: stereo before the upgrade (Aleksic et al., 2012). Squares: stereo after the upgrade: zenith angle 
below 30° (red, filled), 30 — 45° (blue, empty). Both panels are reproduced from Aleksic et al. (2015b). 


The integral sensitivity evaluated above is valid only for sources with a Crab Nebula-like spec¬ 
trum. To assess the performance of the MAGIC telescopes for sources with an arbitrary spectral 
shape, we compute the differential sensitivity, i.e. the sensitivity in narrow bins of energy (5 bins 
per decade). The differential sensitivity is plotted for low and medium zenith angles in right panel 
of Fig. The sensitivity computed also according to different definitions is presented in Aleksic 
et al. (2015b). 

The upgrade of the MAGIC-I camera and readout of the MAGIC telescopes has lead to a 
significant improvement in sensitivity over the whole investigated energy range. The integral sen¬ 
sitivity reaches down to about 0.55% of C.U.^ around a few hundred GeV in 50 h of observations. 
The improvement in the performance is especially evident at the lowest energies. In particular, in 
the energy bin 60-100 GeV, the differential sensitivity decreased from 10.5% C.U. to 6.7% C.U. 
reducing the needed observation time by a factor of 2.5. Observations at medium zenith angle have 
naturally higher energy threshold, degrading the performance at the lowest energies. On the other 
hand such observations provide a small boost in the sensitivity at the TeV energies. 

4. Systematic uncertainties 

The systematic uncertainties of the lACT technique are a combination of multiple small in¬ 
dividual factors which are only known with limited precision, and possibly evolve in time. Most 
of those factors (e.g. uncertainties connected with the atmosphere, reflectivity of the mirrors, etc.) 
were not affected by the upgrade. On the other hand the upgrade led to a decrease of the systematic 
uncertainty connected to background homogeneity (Aleksic et ah, 2015b). The total systematic un¬ 
certainty can be divided into 3 components: pure flux normalization uncerfainfy, uncerfainfy in fhe 
energy scale (which can be converfed info an addifional uncerfainfy in fhe flux normalizafion) and 

*Crab Unit, i.e. the flux of Crab Nebula, which is a standard candle in VHE y-ray astronomy. 
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uncertainty in the spectral index. The final systematic uncertainties have been reevaluated in Alek- 
sic et al. (2015b). The uncertainty on the flux normalization is 18% at low energies (< lOOGeV) 
and 11% in the energy range of a few hundred GeV. At the highest energies, > 1 TeV, due to more 
pronounced MC/data mismatches the systematic uncertainty is a bit higher, namely 16%. The 
uncertainty of the absolute energy scale of the MAGIC telescopes is below 15%. The systematic 
uncertainty on the reconstructed spectral slope of the sources is ±0.15 for observations not strongly 
dominated by background events. 

5. Conclusions 

The upgrade of the readout and one of the cameras of the MAGIC telescopes have significantly 
improved their performance. The trigger threshold for low zenith angle observations is ~ 50 GeV. 
For a Crab-like source, the best performance of the MAGIC telescopes is achieved at energies of a 
few hundred GeV. At those energies the images are sufficiently large to provide enough information 
for efficient reconstruction, while the rapidly falling power-law spectrum of the Crab Nebula still 
provides enough statistics. The energy resolution at these medium energies is as good as 16% with 
a negligible bias and the angular resolution is < 0.07°. The achieved sensitivity above 220 GeV 
is (0.66 ±0.03)% of C.U. for 50h of observations. At the lowest energies, below lOOGeV, the 
performance has improved drastically compaiing to the one presented in Aleksic et al. (2012), 
reducing the needed observation time by a factor of 2.5. 

The performance of the MAGIC telescopes at medium zenith angles, 30 — 45°, is mostly sim¬ 
ilar to the one at low zenith angles. The higher threshold, however, significantly degraded all 
the performance parameters below ~ 200 GeV. However, for the energies above a few TeV, better 
performance is achieved with observations at medium zenith angles. 

Thanks to the improvement in the performance achieved after the upgrade, the MAGIC tele¬ 
scopes have reached an unprecedented sensitivity, which caused a significant boost in the scientific 
output of the experiment. In particular the excellent low energy performance allowed to expand 
the visible VHE y-ray sky up to redshift ~ 0.94 with the detection of two distant blazars: QSO 
B0218-I-357 (Mirzoyan, 2014) and PKS1441-1-25 (Mirzoyan, 2015). 
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